Deep Temporal Contrastive Clustering

نویسندگان

چکیده

Recently the deep learning has shown its advantage in representation and clustering for time series data. Despite considerable progress, existing approaches mostly seek to train neural network by some instance reconstruction based or cluster distribution objective, which, however, lack ability exploit sample-wise (or augmentation-wise) contrastive information even higher-level (e.g., cluster-level) contrastiveness discriminative clustering-friendly representations. In light of this, this paper presents a temporal (DTCC) approach, which first time, our knowledge, incorporates paradigm into research. Specifically, with two parallel views generated from original their augmentations, we utilize identical auto-encoders learn corresponding representations, meantime perform incorporating k-means objective. Further, levels are simultaneously enforced capture instance-level cluster-level information, respectively. With loss auto-encoder, loss, losses jointly optimized, architecture is trained self-supervised manner result can thereby be obtained. Experiments on variety datasets demonstrate superiority DTCC approach over state-of-the-art. The code available at https://github.com/07zy/DTCC .

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Deep Temporal Clustering : Fully Unsupervised Learning of Time-Domain Features

Unsupervised learning of time series data, also known as temporal clustering, is a challenging problem in machine learning. Here we propose a novel algorithm, Deep Temporal Clustering (DTC), to naturally integrate dimensionality reduction and temporal clustering into a single end-to-end learning framework, fully unsupervised. The algorithm utilizes an autoencoder for temporal dimensionality red...

متن کامل

Disambiguating temporal-contrastive connectives for machine translation

Temporal–contrastive discourse connectives (although, while, since, etc.) signal various types of relations between clauses such as temporal, contrast, concession and cause. They are often ambiguous and therefore difficult to translate from one language to another. We discuss several new and translation-oriented experiments for the disambiguation of a specific subset of discourse connectives in...

متن کامل

Learning Deep Energy Models: Contrastive Divergence vs. Amortized MLE

We propose a number of new algorithms for learning deep energy models from data motivated by a recent Stein variational gradient descent (SVGD) algorithm, including a Stein contrastive divergence (SteinCD) that integrates CD with SVGD based on their theoretical connections, and a SteinGAN that trains an auxiliary generator to generate the negative samples in maximum likelihood estimation (MLE)....

متن کامل

Temporal Clustering

We study the problem of clustering sequences of unlabeled point sets taken from a common metric space. Such scenarios arise naturally in applications where a system or process is observed in distinct time intervals, such as biological surveys and contagious disease surveillance. In this more general setting existing algorithms for classical (i.e. static) clustering problems are not applicable a...

متن کامل

Deep generative-contrastive networks for facial expression recognition

As the expressive depth of an emotional face differs with individuals, expressions, or situations, recognizing an expression using a single facial image at a moment is difficult. One of the approaches to alleviate this difficulty is using a video-based method that utilizes multiple frames to extract temporal information between facial expression images. In this paper, we attempt to utilize a ge...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neural Processing Letters

سال: 2023

ISSN: ['1573-773X', '1370-4621']

DOI: https://doi.org/10.1007/s11063-023-11287-0